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3) n Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 19-41 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) n Claim(s) is/are allowed. 

6) |EI Claim(s) 19-41 is/are rejected. 
?)□ Claim(s) is/are objected to. 

8) n Claim(s) are subject to restriction and/or election requirement. 
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Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including tlie fee set fortli 
in 37 CFR 1 .1 7(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
September 12'^ 2008 has been entered. 

Response to Arguments 

2. Applicant's arguments with respect to claims 19, 29 and 37 have been considered 
but are moot in view of the new ground(s) of rejection. 

Claim Rejections - 35 USC §112 

3. The following is a quotation of the second paragraph of 35 U.S.C. 1 12: 

The specification sliall conclude witli one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

4. Claim 19-41 are rejected under 35 U.S.C. 112, second paragraph, as being 
indefinite for failing to particularly point out and distinctly claim the subject matter 
which applicant regards as the invention. 

Claim 19 recites the limitations of "searching the multimedia signal to identify 
an occurrence of the search parameter in the first data format component of the 
multimedia signal" and "delimiting the first data format component of the multimedia 
signal from a beginning of the identified occurrence of the search parameter to an 
end of the identified occurrence of the search parameter". As best understood by 
the examiner, it appears that the claim language as recited appears to be delimiting 
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the beginning and end searcli parameter itself because botli tlie beginning and tlie 
end correspond to tlie same occurrence of an identified searcli parameter, whereas 
applicant's disclosure teaches that the keyword delimits tlie start and end of a 
multimedia segment, i.e. the beginning and end would correspond to different 
occurrences (e.g. first and second occurrence) of the identified search parameter, 
thereby delimiting the segment between the two occurrences of the identified search 
parameter. 

Claims 29 and 37 are rendered indefinite for similar reasons as claim 19. 
Claims 20-28, 30-36 and 38-41 are rendered indefinite for depending on 
indefinite claims 19, 29 and 37 respectively. 

Claim Rejections - 35 USC § 102 

5. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 1 02 that form 
the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351 (a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 

6. Claims 19-32, 35-38, and 40-41 rejected under 35 U.S.C. 102(e) as being 
anticipated by Ahmad et al. (US Pat. 6,263,507). 

With regards to claim 19, Ahmad discloses a method of partitioning a 
contiguous set of multimedia information into "segments" by using identification of 
markers and/or the occurrence of particular word or sequence of words in the text 
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data (e.g. closed captioning) corresponding to an audio-visual data. See column 23, 
lines 36-59. Ahmad accordingly utilizes a method for searching a "search 
parameter" (i.e. the word or sequence of words identifying the break) in a multimedia 
signal (e.g. television signal comprising closed captioning) comprising: 

Determining the "search parameter" that form the basis of partitioning the 
multimedia signal into segments (see column 23, lines 50-59) wherein the search 
parameter maybe determined in a text format such as closed captioning and the 
multimedia signal comprises data in format component (text data) and a second 
format component (video). 

It is further noted that the step of "identification of the occurrence of a particular 
word" (see column 23, lines 53-55) anticipates the claimed step of "searching the 
multimedia signal to identify the occurrence of the search parameter in the first data 
format component of the multimedia signal". 

The method of Ahmad is further used to determine segment demarcation or 
partitioning upon the identification of particular words in the first data component 
(see column 23, lines 26-28 and lines 50-52) and therefore anticipates the claimed 
step of "delimiting the first data format component of the multimedia signal from a 
beginning of the identified occurrence of the search parameter to an end of the 
identified occurrence of the search parameter"; 

Ahmad further discloses the step of determining a portion of the second data 
format (video portion) that corresponds to the delimited first data format component 
of the multimedia signal, and synchronizing the corresponding second data 
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component using coarse and fine portioning (see column 26, lines 3-18 and column 
27, lines 29-37). Therefore Ahmad further anticipates the claimed step of 
"synchronizing a first segment and a second segment of the multimedia signal, 
wherein the first segment includes the occurrence of the search parameter in the 
first data format component of the multimedia signal and the second segment 
includes the portion of the second data format component of the multimedia signal 
that corresponds to the delimited first data format component". 

With regards to claims 20 and 22, Ahmad discloses the scenario wherein the first 
data format is a closed caption component of the multimedia signal and the second 
data format component is an audio component or a video component of the 
multimedia signal (see column 23, lines 36-38). 

With regards to claim 21 , Ahmad discloses that the second segment of 
multimedia signal is a section of the audio component that begins and ends within a 
predetermined period of time before and after the occurrence of the search 
parameter in the closed caption component (see column 26 lines 65-column 27, line 
3) 

With regards to claim 23, Ahmad discloses that the second segment of 
multimedia signal is a section of the video component that begins and ends within a 
predetermined period of time before and after the occurrence of the search 
parameter in the closed caption component (see column 26 lines 65-column 27, line 
3). 
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With regards to claim 24, Alimad discloses that video data includes images (see 
column 9, lines 51-53). 

With regards to claim 25, Ahmad also discloses the scenario wherein the first 
data format is an audio format (see column 24, lines 10-12, and lines 30-37) and the 
second data format is a video format of the multimedia signal (see column 24, lines 
2-9). 

With regards to claims 26 and 40, Ahmad discloses that the format of the first 
data format component and second data format component are selected from the 
group consisting of: text data, closed caption data, audio data, speech data and 
video data. 

With regards to claim 27, Ahmad also discloses the scenario wherein when the 
closed captioning data is not available, the audio component is used to produce the 
text data using speech recognition methods (see column 25, lines 65-67). In such a 
scenario, Ahmad teaches receiving a third format component of audio, second 
format component of video, and determining search parameters in a third data 
format and converting the search parameter from the third data format to the first 
data format (i.e. text). 

With regards to claim 28, Ahmad discloses that the format of the third data format 
component and the first data format component are selected from the group 
consisting of: text data, and audio data. 

With regards to claim 29, Ahmad discloses a method of processing a multimedia 
signal comprising: 
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Analyzing a first data format component (e.g. text data sucli as closed 
caption) of the multimedia signal to identify an occurrence of a search parameter 
(see column 23, lines 36-59); 

The method of Ahmad is used to determine segment demarcation or 
partitioning upon the identification of particular words in the first data component 
(see column 23, lines 26-28 and lines 50-52) and therefore anticipates the claimed 
step of "delimiting the first data format component of the multimedia signal from a 
beginning of the identified occurrence of the search parameter to an end of the 
identified occurrence of the search parameter"; 

Ahmad further discloses the step of determining a portion of the second data 
format (video portion) that corresponds to the delimited first data format component 
of the multimedia signal, and synchronizing the corresponding second data 
component using coarse and fine portioning (see column 26, lines 3-18 and column 
27, lines 29-37). Therefore Ahmad further anticipates the claimed step of 
"synchronizing a first segment and a second segment of the multimedia signal, 
wherein the first segment includes the occurrence of the search parameter in the 
first data format component of the multimedia signal and the second segment 
includes the portion of the second data format component of the multimedia signal 
that corresponds to the delimited first data format component". 

With regards to claim 30, Ahmad discloses displaying the segment of the video 
component to a user, when the second data format is a video component (see 
column 2, lines 66-column 3, line 4). 
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With regards to claim 31 , Alimad discloses displaying a segment of the video 
component comprising a single image (see column 9, lines 51-53). 

With regards to claim 32, the video component is a video clip of predetermined 
length that substantially corresponds to an occurrence of the search parameter in 
the first data format component (see column 26 lines 65-column 27, line 3). 

With regards to claim 35, Ahmad also discloses the scenario wherein when the 
closed captioning data is not available, the audio component is used to produce the 
text data using speech recognition methods (see column 25, lines 65-67). In such a 
scenario, Ahmad teaches determining search parameters in a third data format and 
converting the search parameter from the third data format to the first data format 
(i.e. text). 

With regard to claim 36, Ahmad utilizes known speech recognition methods to 
produce text data from audio data. Accordingly Ahmad uses speech to text 
converter. 

With regards to claim 37, Ahmad discloses a method of processing a multimedia 
signal comprising: 

Determining the "search parameter" that form the basis of partitioning the 
multimedia signal into segments (see column 23, lines 50-59) wherein the search 
parameter maybe determined in a text format such as closed captioning and the 
multimedia signal comprises data in format component (text data) and a second 
format component (video). 
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It is furtlier noted tliat tlie step of "identification of tlie occurrence of a particular 
word" (see column 23, lines 53-55) anticipates the claimed step of "processing the 
multimedia signal to identify the occurrence of the search parameter in a first data 
format component of the multimedia signal", wherein the multimedia signal has at 
least the first component (e.g. text data such as closed caption) and a second 
component (video) being in a first data format and a second data format 
respectively. 

The method of Ahmad is used to determine segment demarcation or 
partitioning upon the identification of particular words in the first data component 
(see column 23, lines 26-28 and lines 50-52) and therefore anticipates the claimed 
step of "delimiting the first data format component of the multimedia signal from a 
beginning of the identified occurrence of the search parameter to an end of the 
identified occurrence of the search. 

Ahmad further discloses the step of determining a portion of the second data 
format (video portion) that corresponds to the delimited first data format component 
of the multimedia signal, and synchronizing the corresponding second data 
component using coarse and fine portioning (see column 26, lines 3-18 and column 
27, lines 29-37). 

With regards to claim 38, Ahmad also discloses the scenario wherein when the 
closed captioning data is not available, the audio component is used to produce the 
text data using speech recognition methods (see column 25, lines 65-67). In such a 
scenario, Ahmad teaches determining search parameters in a format different from 
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the first data format and converting tlie searcli parameter to tlie first data format (i.e. 
text). 

Witli regard to claim 41 , Alimad discloses the step of determining a portion of 
the second data format (video portion) that corresponds to the delimited first data 
format component of the multimedia signal, and synchronizing the corresponding 
second data component using coarse and fine portioning (see column 26, lines 3-18 
and column 27, lines 29-37). Therefore Ahmad further anticipates the claimed step 
of "synchronizing a first segment and a second segment of the multimedia signal, 
wherein the first segment includes the occurrence of the search parameter in the 
first data format component of the multimedia signal and the second segment 
includes the portion of the second data format component of the multimedia signal 
that corresponds to the delimited first data format component". 

Claim Rejections - 35 USC § 103 

7. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or deschbed as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the phor art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

8. Claims 33-34 and 39 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Ahmad et al. (US Pat. 6,263,507) 

With regards to claims 33 and 39, Ahmad also discloses that audio segments 
maybe delimited by known words and/or sequence of words. Determination of when 
such known words occur, requires the system to maintain a database of what 



Application/Control Number: 09/841 ,327 Page 1 1 

Art Unit: 2623 

constitutes sucli "l<nown" words. Wliile Alinnad is silent on tlie step of format 
component for tlie l<nown words in sucli a database, examiner takes Official notice 
that it was well known to maintain a dictionary of such "known" words in a text 
format. Official notice is further taken that it text to speech converters were well 
known in the art at the time of the invention. As such, it would have been obvious to 
one of ordinary skill in the art to generate an audio signal of a "known" word that is of 
a text format in a dictionary and compare the converted audio signal to the audio 
signal of the multimedia signal to detect audio delimiters. 

With regards to claim 34, the modified system of Ahmad utilizes a text to 
speech converter to convert the search parameter into a text format. 

Conclusion 

9. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Luther (US Pat. 5,555,343) is evidence to one of ordinary skill in the art that 
text to speech converters were well known at the time of the invention. 

Corey et al. (US Pat. 5,703,655) discloses a method for using detecting 
logical breaks in a closed caption text to decompose video into segments. 

10. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to USHA RAMAN whose telephone number is 
(571)272-7380. The examiner can normally be reached on Mon-Fri: 9am-6pm. 

If attempts to reach the examiner by telephone are unsuccessful, the 
examiner's supervisor, Christopher Kelley can be reached on (571) 272-7331 . The 
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fax phone number for the organization where this application or proceeding is 
assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR 
only. For more information about the PAIR system, see http://pair-direct.uspto.gov. 
Should you have questions on access to the Private PAIR system, contact the 
Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like 
assistance from a USPTO Customer Service Representative or access to the 
automated information system, call 800-786-9199 (IN USA OR CANADA) or 571- 
272-1000. 



UR 



/Chris Kelley/ 

Supervisory Patent Examiner, Art 
Unit 2623 



